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ABSTRACT 

Limitations in past research in educational 
television and guidelines for conducting more fruitful future 
research are identified. The current practice of utilizing few, if 
any, common criterion measures of effectiveness presents difficulties 
in the attempt to generalize from current research on ETV, An 
important initial effort in attempting to improve research in ETV 
would be to isolate those factors in the learning situation that 
might produce changes in the behavior of pupils viewing television. 
It would seem appropriate that an attempt be made to measure the 
question-asking behavior of both the studio teacher and the classroom 
teacher involved in the establishment of learning experiences for a 
particular group of pupils. Based on an evaluation of the literature 
and the author's research, the following recommendations for future 
research are proposed: (1) Teachers selected for participation in 
studies utilizing ETV should volunteer and/or have a favorable 
attitude toward the use of ETV; (2) Eliminate comparison studies, 
e.g., TV science versus non-TV science instruction; (3) Increase 
emphasis on developmental (formative) research that can aid in the 
design and implementation of the particular TV series— selection of 
evaluative instruments that measure each specific program objective, 
increased emphasis on measure of verbal and non-verbal behavior of 
studio and classroom teachers, and increased emphasis on measures of 
verbal and non--verbal behavior of students receiving TV instruction, 
A 20-item bibliography is provided. (DB) 
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What Instructional TV Research Says 
to the Researcher 

Since instructional television's debut in the early 1950's, numerous 
large-scale research projects and individual investigations have sought to 
determine the effectiveness of this form of mediated instruction in the 
classroom. This interest and research in the educational utility of 
television vas stimulated "... by a predicted and actual shortage of compe- 
tent teachers and by the need to educate a rapidly growing population which 
had to learn more than ever before because of the explosion of human knowledge 

(Greenhill, 1967)." 

The purpose of this paper is to identify limitations in past research 
efforts in ETV and to identify guidelines for conducting more fruitful efforts 
in the future. 

Early studies, supported by the National Educational Television and 
Radio Center and the Ford and Rcck^fel?.er Fcundations, were, at best, ana- 
lytical. Exemplary research, largely concerned vjith studies of the feasi- 
bility of large class instruction by television, scheduling and school 
building problems in utilizing television, budgetary implications, economies 
of teacher time, space, and methods of developing teacher talent for large 
and small group instruction with television, is found in Proceedings of the 
I^^T? A Lea dership Seminar on the Role of Television in In struction (NEA, 1958). 
Underlying this type of research seemed to be the assumption that in instruc- 
tional television rested the solution to perennial problems of teacher shor- 
tage, overcrowded classrooms, and inadequate teacher inservice experiences — 
especially in sucli subjects as math and science where instruction was con- 
sidered substandard^ and national priorities high. 



Understandably, tT.70 prime areas of further research recommended by the NEA 
conference were the optimum distribution of television teachers among other 
methods and techniques, and the manifold problems arising from consi- 

deration and acceptance of TV teaching by parents, pupils, and educators 
..• (NEA, 1958).^* 

So intense was educational television research immediately following 
its implementation in the educational ^'establishment", that Greenhill (1967) 
has cited the 1954-64 decade as "... the era of most intensive research on 
Instructional television." A flurry of research was particularly obvious 
following enactment of Title VII of the National Defense Educational Act of 
1958 which authorized the expenditure of federal monies to support research, 
experimentation, and dissemination of information about communication media. 
Kittross (1959) explained "... there was an 'open season* on almost any ETV 
research problem that could be conjectured in the mind of a potential 
^principal investigator " Over a thousand projects were initiated, the vast 
majority of which were "comparative effectiveness" studies aimed at deter- 
mining the superiority of television instruction or direct teaching in the 
clcssroom. 

Even though most of the research generated by this massive effort has 
been published, Schramm (1962) uncovered 400 additional unpublished descrip- 
tive or analytic studies of specific programs in local school districts. 
This proliferation of research did little to improve the quality of research 
being done at that time, however. 

Has educational television (ETV) research been meaningful? One basis 
for this quest-Ion raised by Kittross (1969) lay in several major reviews of 



the literature prepared by Schramm (1960), Kum-^tra (1960), Schranim (1962), 
Greetihill (1967), Reid and McLennon (1967), Kittrcjs (1969), and Chu and 
Schramm (1967). In each case, after considering hundreds of ''comparative 
effectiveness" studies, the same conclusion was c!rawn--students learn about 
as much by television as with face-to-face instruction--or , as SchrarruT: (1962) 
more optimistically pointed out, "Instructional television is at least as 
effective as ordinary classroom instruction (and, when taught by television) 
math and science have been outstandingly successful 

Reports by Lumsdaine and Orr (1959), Suchy and Baumann (1960), Rothchild 
nnd Lastinger (1961), Pflieger and Kelly (1961), and Jenkins (1964) illus- 
trate the comprehensiveness of these comparative studies. In the Milwaukee 
Project, involving 9,000 secondary students over a three year period, Suchy 
and Bnumann (1960) u::ilized both teacher opinion and achievement data to 
rfjsess ef fectf vGness. Six thousand students in 192 schools vjere involved in 
the Denver TV Project (Schramm, 1962), 4,000 third and fourth graders in 
che Ohio study reported by Fra^ier and i£vans (1960), and nearly 7,000 ele- 
mentary and secondary pupils in the Florida West Coaf^t Project (Rothchild 
an-l Lastinger, 1961). 

In Schramm's (1962) analysis -^C 3S3 comparinoi-'s, 63 percent showed no 
rilgnif icant differences; in 21 oe^*:cnt, pupils learned significantly more 
from television; and Jn 1^: pcrce of the comparisons, pupils learned sig- 
nificantly less irom televioion. Five years later, Chu and Schramm (1967) 
confirmed this trend; in 4^1 r^oparate comparisons in 207 published studies, 
303 were non- significant, C\> t;cvg sl^5nificant for television, and 50 signi- 
.Jicantly favored conventional teaching. 
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Kittross (1969) suggested tvo reasons why ETV research had led to so 
feu ''practical" results* First, he suggested that those uho are conductions 
the research might be lacking in training, ability, or inclination to con-^ 
duct meaningful research. As Skornia (1966) mentioned, "Many of the so- 
callec' research reports are products of wrke-s with no research training 
or standards. They do not stand up under any valid research ciiteria." 
He further states that there are very fevj professional researchers qualified 
to do both connminications and educational research. An apparently good 
or.ample of this vjas found in the analysis ^nade by Stlckell (1963) of 31 
studies that made 250 comparisons betvjeGn ET^^ and conventional instruction. 
Only 10 of these 250 comparisons x?Gre fully interpretable on the basis of 
five criteria: (1) comparability of control and experimental subjects, 
(2) assignment procedures, (3) coinnarability of instructions, (^:) ten- 
^:billty of staListical assu-nptions, and (5) adequacy of other controls. 
Two hundred seventecu failed to moot tjo or more of the criteria and were 
ropcidered by Stickell to be urlr':crprc'-:i'^lc. 

It is possible that the tecbriiqnos and ♦nrr.curing instri^ments were too 
inprecise or invalid for adequate Jo. termination of differences which existed. 
'Jhen revie^^-^g the ^ iter-i'-'.-ro c' l :f^»crivc:iG'^^ of ETV in general, and 
nr-rp specifically, c\Kn\^zory scl:*'. G-^Ionce tej^^^'^sed inr< r;:ction, one 
ccnnot hc-lo rv/c nr»t:'^c» t';^/ '-^^^ -IL'zionc'i ?n*:jrprc^tatiorj of effectiveness 
opz been in ter;:.r f^f ' acl ;.evements--facts, knowledge, information 

accttired. 

Conrl'^ri-f t^j ' ^ndlvi Jva?, progr':r^'M.ng efforts throughout 

the United States, is reascr.r^Mi- to expect the identification and/or 



development of a vide variety of measures of achievement x^hich are consistent 
with the objectives of the individual programs. The choices made concerning 
the type of test to administer (e.g. standardized versus a locally-contructed 
test meeting specific criteria--grade level, content or process emphasis, 
etc.)> however, creates potential difficulties with both the prcciseness and 
validity of the instruments. The current practice of utilizing few, if any, 
common criterion measures of effectiveness presents difficulties in the 
attempt to generalize from current research on ETV. 

As a second reason why ETV research has led to few "practical" results, 
Kittross (1969) suggested that there "might be something wrong with the 
entire concept of ETV research as practiced thus far." Upon reviewing the 
research on the forms of effective teaching from film and ETV, Schramm 
(1962) suggested that the net result so far was to reinforce the belief that 
good teachirg is much the same on TV, on films, or in the classroom. 

Chu and Schramm (1967) stated that instructional television 'V7orks best 
when it is made an integral part of instruction— that is, when it is woven 
into a classroom context of learning activities; indeed, when the studio 
and classroon teachers function as nearly as possible as a teaching team." 

Schramm (1962) and Suchman (1966) assunied that, in the elementary 
school, the TV lesson itself forms only one component of th'e learning experience 
that the classroom teacher carefully builds his lesson around the TV experience^ 
providing initial preparation, immediate follow-up, and other learning 
experiences which TV cannot so readily accomplish. From information gained 
from the Denver Project, Chu and Scr.ramm suggested that a skillful classroom 
teacher was the best learning aid that could be combined with television. 
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Shram (1962) urged researchers to shift their emphasis from the uniqueness 
of television to the totality of the learning process. "The mos'c important 
research in instructional television is nox'j ••• research on the total process 
of which television is a part." Uhile this recorinendation has been reiterated 
in every major reviev? of ETV literatura, only in ihe last five years have 
investigations taken this perspective. 

Thus, the classroom teacher has a major responsibility for the success 
of ETV in his classroom. It Tvould appear that an important initial effort 
in attempting to improve research In ETV T.?uuld be to isolate those factors in 
the learning situation that might produce changes in the behavior of pupils 
viewing celovision. 

Williams (1962) suggested that "the attitudes, ability and personality 
of the classroom teacher may be the most important rcissing variables in 
measuring effectiveness of ETV." One could conb?nd, in addition, that the 
overt verbal behavior of the studio and classroom teacher might also 
significantly affect the effectiveness of televised instruction. 

If, as Schramm suggested, good teaching is ttuch the same ^}hether on 
TV or in the classroom, and, much of the current research on classroom 
teaching ef fectivaness is a measure of teacher verbal behavior (e.g. ques- 
tion-asking behavior), then it \7ould seem appropriate co the investigator to 
attempt to measure the question-asking behavior of both the studio teacher 
apd the classroom teacher involved in the establishment 'of learning 
experiences for a particular group of pupils. 

Because the investigation of teacher question-asking behavior appears 
V7arranted in helping to measure ^:he effectiveness of ETV, it uould seem that 
researchers have missed a potentially fruitful avenue for their efforts. 



Only recently have research efforts been guided in this direction (Beisenherz, 
(1971; Tucker, 1971). In these studies, multi-category question systems were 
utilized to determine the effectiveness of a locally televised elementary 
school science series in the Seattle, Washington area. The verbal question- 
ing behavior of studio (TV) and classroom teachers was analyzed in terms of 
the proportions of questions emphasizing different levels of thinking, pro- 
cess skill developraent, and different phases of a model instructional stra- 
tegy identified by the authors. 



Implications for future research . 

Based on an evaluation of the literature and research conducted by the 
authors, the folloxjing recommendations for future research are proposed. 

1) Teachers selected for participation in studies utilizing ETV 
should volunteer and/or have a favorable attitude touard the 
use of ETV in their classrooms. Because of the Importance 
of the classroom teacher to the successful implementation of 
the TV program in his classroom, it can be hypothesized that 
those teachers V7ho react positively to this medium vill be 
more effective in its utilization. Although the extent or 
generalizability is decreased v/ith this procedure, the findings 
X7ill more accurately describe the population of teachers who 
nornally view ETV. Once selection of these teachers has been 
accomplished, random placement of the teachers into treatment 
grctn)S can occur. 

2) iUimination of comparison studies, e.g. TV science versus non- 
TV science instruction. The unsuccessful attempt in prior 
research efforts to control all the many variables inlierent 

in this type of design strongly suggests an emphasis on the 
identification and evaluation of each of the objectives of the 
particular TV programming effort. 

3) Increased emphasis on developmental (formative) research that 
can aid in the design and implementation of the particular 

TV series. 

a) Selection of evaluative instruments that measure each 
specific program objective. Fev? standardized tests 
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can be identified that provide the "match" betxjeen test objectives 
and the objectives of the particular series. The increased 
use of locally developed and validated instruments in studies 
evaluai:ing televised instruction, however, has implications for 
the btoad generalizability of findings to the body of TV research. 

b) Increased emphasis on measure of verbal and non-verbal behavior 

of studio (TV) and classroom teachers, e.g. questioning strategies, 
that arc consistent with the nature of the discipline presented. 
Only through the identification and observation of these behaviors 
can the finished TV production be maximally effective in the 
c3,ascroor.;, 

c) Increased emphasis on measures of verbal and non-verbal behavior 
of students receiving the TV instruction. If students do not 
respond to a particular technique, question, strategy, the impli- 
cations are clear to the TV program developer. 

It would appear that the development of a TV production includes 
three phases: 

1) identification of appropriate objectives and instructional 
strategiese 

2) identification of key activities, questions, and their sequence 
for each lessen. 

3) implementatior of the programming effort to the vieuing audience. 

i'o realise marlmiim effectiveness o-: twe prod-iction in terras of pupil 
mastery of each objertive. research (or evaluation) should be en important 
aspect of phases two and three above. 
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